Performance Analysis of a Cluster File System
نویسندگان
چکیده
Design of cluster file system is very important for building a general-purpose cluster with commodity components. To provide scalable high I/O performance needed in the scientific computing, engineering computing, Internet/Intranet services, I/O intensive commercial database and multimedia application, we designed a high-performance cluster file system named COSMOS. This paper presents the basic characteristics of the cluster file system and its performance analysis. The performance of the COSMOS file system is evaluated on the platform of Dawning/2000 superserver, using standard I/O performance benchmarks. Our tests show satisfactory bandwidth and overall performance of COSMOS, and the system scales well. Based on implementation experience and the raw data, we discuss the bottleneck of the existing system and propose methods to improve the system.
منابع مشابه
Analysis of Long-Term File System Activities on Cluster Systems
I/O workload is a critical and important factor to analyze I/O pattern and to maximize file system performance. However to measure I/O workload on running distributed parallel file system is non-trivial due to collection overhead and large volume of data. In this paper, we measured and analyzed file system activities on two large-scale cluster systems which had TFlops level high performance com...
متن کاملDesign and implementation of PVFS-PM: a cluster file system on SCore
This paper discusses the design and implementation of a cluster file system, called PVFS-PM, on the SCore cluster system software. This is the first attempt to implement a cluster file system on the SCore system. It is based on the PVFS cluster file system but replaces TCP with the PMv2 communication library supported by SCore to provide a scalable, high-performance cluster file system. PVFS-PM...
متن کاملThe Global File System: A File System for Shared Disk Storage
In this paper we present a new storage architecture for clusters that creates a shared memory of disk storage that is uniformly accessible to all cluster clients, scales to large capacity, and provides very high performance and connectivity. The cluster structure resembles a symmetric multiprocessor (SMP) in that clients (processors) can access disk data (memory) across a local area network lik...
متن کاملAdaptive Dual-Cache Scheme with Dynamic Prefetching Scheme in Parallel File System
An adaptive Dual-Cache Scheme(DCS) and dynamic prefetching scheme were designed to improve the performance of the Parallel File System for Linux(PFSL). PFSL is a parallel file system for a clustering environment and is implemented using a multi-threaded programming technique with POSIX thread libraries supported by Linux. The proposed adaptive DCS and dynamic prefetching scheme both reflect the...
متن کاملEvaluation of iPVFS: A High Performance Parallel File System over iSCSI for Cluster Computing
In this paper we propose a high performance parallel file system over iSCSI (iPVFS) for cluster computing. iPVFS provides a cost-effective solution for heterogeneous cluster environments by dividing a set of I/O servers into two groups. One group, with higher performance, serves as I/O nodes, while the other group, with relatively lower performance, serves as storage target nodes. This combinat...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2000